CONVEX MINIMIZATION PROBLEMS 
WITH WEAK CONSTRAINT QUALIFICATIONS 



CHRISTIAN LEONARD 

Abstract. One revisits the standard saddle-point method based on conjugate duality 
for solving convex minimization problems. Our aim is to reduce or remove unnecessary 
topological restrictions on the constraint set. Dual equalities and characterizations of 
the minimizers are obtained with weak or without constraint qualifications. 
The main idea is to work with intrinsic topologies which reflect some geometry of the 
objective function. 

The abstract results of this article are applied in other papers to the Monge-Kantorovich 
optimal transport problem and the minimization of entropy functionals. 
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1. Introduction 

An extension" of the saddle-point method for solving a convex minimization problem 
is investigated. It is shown how to implement the standard saddle-point method in such 
a way that topological restrictions on the constraint sets (the constraint qualifications) 
may essentially be removed. With this aim in view, one works with topologies associated 
with gauge functionals of sets which are close to the level sets of the objective function. 
These well-suited topologies partly reflect the geometry of the problem. 
At some point, one has to compute an extended dual problem. This is the price to pay 
for implementing this approach. 

The method is based on conjugate duality as developed by R.T. Rockafellar in [TT]. Dual 
equalities and characterizations of the minimizers are obtained with weak or without 
constraint qualification. 

This paper is a companion of [8J and [9j where this extended saddle-point method is 
applied to the Monge-Kantorovich optimal transport problem and the minimization of 
entropy functionals. 
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An abstract convex problem and related questions. Let W be a vector space, 
C = U* its algebraic dual space, $ a (—00, +oo]-valued convex function on U and $* 
its convex conjugate for the duality {U,C). Let y be another vector space, X = y* 
its algebraic dual space and T : £ — > A" is a linear operator. We consider the convex 
minimization problem 

minimize subject toTieC, ieC (P) 

where C is a convex subset of A". As is well known, Fenchel's duality leads to the dual 
problem 

maximize inf {y,x) — $(T*y), y Ey (D) 
where T* is the adjoint of T. 

Questions 1.1. The usual questions related to (P) and (D) are 

• the dual equality: Does inf(P) = sup(D) hold? 

• the primal attainment: Does there exist a solution i to (P)? What about the 
minimizing sequences? 

• the dual attainment: Does there exist a solution y to (-D)? 

• the representation of the primal solutions: Find an identity of the type: i G 
d<!>{T*y). 

In the case where the constraint set C = {x} is reduced to a single point, the value 
sup(P') of the dual problem is 

A*{x) ■.= sup{{y,x) -^T*y)}, x e X 

yey 

which is the convex conjugate of A{y) := ^(T*y),y G y. 

We are going to answer the above questions in terms of some extension $ of $ under the 
weak constraint qualification 

CndiffdomAV0 (1-2) 
where diffdom A* = {x G A"; dx*A*{x) 7^ 0} is the subset of all vectors in X at which A* 
admits a nonempty subdifferential with respect to the algebraic dual pairing {X, X*) with 
X* the algebraic dual space of X. Note that by the geometric version of Hahn-Banach 
theorem, the intrinsic core of A* : icordomA*, is included in diffdom A*. Hence, a useful 
criterion to get fll.2p is 

CnicordomAV 0- (1-3) 
The drawback of such a general approach is that one has to compute the extension $. In 
specific examples, this might be a difficult task. In the case of the Monge-Kantorovich 
problem [8] it is immediate, but it requires some work in the case of entropy minimization 

The restriction (11.31) is very weak since the intrinsic core is the notion of interior which 
gives the largest possible set. As C fl domA* = implies that (P) has no solution, the 
only case where the problem remains open when icordomA* is nonempty is the situation 
where C and domA* are tangent to each other. This is used in [9J to obtain general 
results for convex integral functionals. The representation of their minimizers, see (13.71) . 
are obtained under the constraint qualification (11.31) which is much weaker than the usual 
constraint qualification: 

intCn domA* ^ 

where int C is the interior of C with respect to some topology which is not directly 
connected to the "geometry" of A*. In particular, int C must be nonempty; this is a 
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considerable restriction. 

Nevertheless, the Monge-Kantorovich optimal transport problem provides an interesting 
case where the specifications of the constraints never stand in icordomA*, see [HI Remark 
4.9], so that (11. 3p is useless and (11.21) is the right assumption to be used. 

The strategy. A usual way to prove the dual attainment and obtain some representa- 
tion of the primal solutions is to require that the constraint is qualified: a property which 
allows to separate the convex constraint set T~^{C) and the level sets of the objective 
function $*. The strategy of this article is different: one chooses suitable topologies so 
that the level sets have nonempty interiors. This also allows to apply Hahn-Banach theo- 
rem, but this time the constraint set is not required to have a nonempty interior. We take 
the rule not to introduce arbitrary topological assumptions since (P) is expressed without 
any topological notion. Because of the convexity of the problem, one takes advantage 
of geometric easy properties: the topologies to be considered later are associated with 
seminorms which are gauges of level sets of the convex functions $ and $*. They are 
useful tools to work with the geometry of (P). 

It appears that when the constraints are infinite-dimensional one can choose several dif- 
ferent spaces y without modifying the value and the solutions of (P). Consequently, for 
a small space y the dual attainment is not the rule. As a consequence, we are facing the 
problem of finding an extension of {D) which admits solutions in generic cases and such 
that the representation of the primal solution is £ G d^{T*y) where $ is some extension 
of $. 

We are going to 

• use the standard saddle-point approach to convex problems based on conjugate 
duality as developed by Rockafellar in [11] 

• with topologies which refiect some of the geometric structure of the objective 
function. 

These made-to-measure topologies are associated with the gauges of the level sets of $ 
and $*. 

Outline of the paper. The results are stated without proof at Section [2l Their proofs 
are postponed to Section [51 Examples are introduced at Section [3] where one considers 
the Monge-Kantorovich transport and entropy minimization problems. These problems 
are investigated in [8, 9|. 

Notation. Let X and Y be topological vector spaces. The algebraic dual space of X is 
X*, the topological dual space of X is X'. The topology of X weakened by Y is o"(X, Y) 
and one writes {X, Y) to specify that X and Y are in separating duality. 
Let f : X [— oo, +oo] be an extended numerical function. Its convex conjugate with 
respect to {X,Y) is f*{y) = sup3,g^{(a;, — /(x)} G [— cxo, +oo], y eY. Its sub differential 
at X with respect to (X, Y) is dyfix) = {y eY; f{x + > /(^) + (v, If no 

confusion occurs, one writes df{x). 

The intrinsic core of a subset A of a vector space is icoT A = {x G A;Vx' G aS.A,3t > 
0, [x,x + t{x' — x)[g A} where aff A is the affine space spanned by A. icordom/ is the 
intrisic core of the effective domain of / dom/ = {x G X; f{x) < oo}. 
The indicator of a subset A of X is defined by 

/ \ J if X G A ^ ^ ^\ 

'^a{x) <^ -\-oo, otherwise ' ^ • 

The support function of /I C X is L\{y) = sup^g^(x, y), y eY. 
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2. Statements of the results 

The dual equality and the primal attainment are stated at Theorem I2.6j the dual 
attainment and the dual representation of the minimizers are stated at Theorems 12.91 and 
12.121 Their proofs are postponed to Section O 

2.1. Basic diagram. Let Uo be a vector space, Co = algebraic dual space, $o 

a (— oo, +oo]-valued convex function on Uo and $* its convex conjugate for the duality 
{Uo,Co) : 

$:(£):= sup{(M,£)-$„H}, (ieCo 

Let 3^o be another vector space, Xo = y* its algebraic dual space and To : Co ^ is a 
linear operator. We consider the convex minimization problem 

minimize subject to Toi e Co, i e Co (Po) 

where Co is a convex subset of A'q. 

It is useful to define the constraint operator To by means of its adjoint T* : yo ^ C^ as 
follows. For all i G Co, 

{y,Toi)y^,p,^ = {T:y,i)ci,c.^ E yo- 
We shall assume that the restriction 

T:{yo)cUo (2.1) 

holds, where Uo is identified with a subspace of £* = U**- It follows that the diagram 

Uo , Co 



T* To (Diagram 0) 

{yo , Xo 

is meaningful. 

2.2. Assumptions. Let us give the list of our main hypotheses. 

(if$) 1- ^o '■ Uo ^ [0, +oo] is a(Uo, £o)-lower semicontinuous, convex and $o(0) = 

2- \/u e Uo, 3a; > 0, $o(q;m) < oo 

3- Vu eUo,u^ 0, 3t e R, <l>o{tu) > 

{Ht) 1- T:{yo)GUo 

2- ker T* = {0} 
(He) C := Co n A" is a convex (r{X, 3^)-closed subset of X 

The definitions of the vector spaces X and 3^ which appear in the last assumption are 
stated below at Section 12.31 For the moment, let us only say that if Co is convex and 
a{Xo, 3^o)-closed, then (He) holds. 

Comments about the assumptions. 

- By construction, $* is a convex (t(£o, Wo)-closed function, even if $o doesn't satisfy 
(iJ$i). Assuming this property of $o is not a restriction. 

- The assumption (iJ$i) also expresses that $o achieves its minimum at m = and 
that $o(0) = 0. This is a practical normalization requirement which will allow us 
to build a gauge functional associated with $o. More, (-ff#i) implies that $* also 
shares this property. Gauge functionals related to $* will also appear later. 
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- With any convex function $ satisfying (-ff$2), one can associate a function $o 
satisfying (i?$i) in the following manner. Because of (i?#2), ^(0) is finite and 

there exists G Co such that G 9$(0). Then, the closed convex regularization 
$o of M G Wo ^ ^(m)-(4,'u)-*(0), satisfies and = -l>(0), 

- The hypothesis (-^#3) is not a restriction. Indeed, assuming let us suppose 
that there exists a direction 7^ such that ^^oiiUo) = for all real t. Then any 
i E Co such that (£, Kq) 7^ satisfies $*(-^) > sup^^jj Uo) = +00 and can't be a 
solution to (P). 

- The hypothesis {Ht2) isn't a restriction either: If yi — 1/2 G ker T*, we have 
{Toi,yi) — {Toi,y2), for all i E Co- other words, the spaces 3^o and 3^o/ker T^* 
both specify the same constraint sets {£ E Co', Tgl — x}. 

The effective assumptions are the following ones. 

- The specific form of the objective function as a convex conjugate makes it a 
convex (t(£o, Wo)-closed function. 

- {Hq>2) and {He) are geometric restrictions. 

- (i/ri) is a regularity assumption on Tq. 

2.3. Variants of (P) and [D). These variants are expressed below in terms of new 
spaces and functions. Let us first introduce them. 

The norms \ ■ \^ and \ ■ |a- Let ^±{u) = max($o('u), $o(— By (-ff$i) and (-^$2), 
{u E V(o',^±{u) < 1} is a convex absorbing balanced set. Hence its gauge functional 
which is defined for all m G Wo by \u\^ := infja > 0;^±{u/a)) < 1} is a seminorm. 
Thanks to hypothesis (i^^a), it is a norm. 
Taking (Hti) into account, one can define 

Ao(y):=$o(T»,i/G3^o. (2.2) 

Let A±{y) = max(Ao(y), Ao{—y)). The gauge functional on 3^o of the set {y E yo', A±(?/) < 
1} is |y|A := infjo; > 0;A±{y/a) < l},y E y^o- Thanks to (H^) and (Ht), it is a norm 
and 

\y\A=\T:y\^, yEyo. (2.3) 

The spaces. Let 

U be the | ■ [^-completion of Uo and let 

C :— {Uo, I • 1$)' be the topological dual space of {Uo, \ ■ |$). 

Of course, we have (W, | • |$)' = £ C Co where any £ in £ is identified with its restriction 
to Uo- Similarly, we introduce 

y the I ■ |A-completion of 3^o and 

^ '-— {yo: I • I a)' the topological dual space of {yo, \ ■ \a)- 

We have (3^, | ■ |a)' = X E X,, where any x in y' is identified with its restriction to yo- 
We also have to consider the algebraic dual spaces C* and X* of C and X . 
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The operators T and T* . It will be proved at Lemma 14.131 that 

ToC C X (2.4) 

Let us denote T the restriction of To to £ C Co- By ( 12. 4p . we have T : C ^ X. Let us 
define its adjoint T* : X* ^ C* for all u e X* by: 

This definition is meaningful, thanks to (12.41) . It will be proved at Lemma [4. 131 that 

T*y C U (2.5) 
We have the inclusions 3^o C 3^ C A"*. The adjoint operator T* is the restriction of T* to 

yo. 

Some modifications of o-nd Ao. We introduce the following modifications of $o : 

$(m) := sup{(u,£) -$:(£)}, ueU 
lac 

$(C) := sup{(£,C) -$*(£)}, 

They are respectively a{lA,C) and cr(£*, £)-closed convex functions. It is immediate to 
see that the restriction of $ to W is $. As £ = W, $ is also the | ■ |$-closed convex 
regularization of $o- The function $ is the extension which appears in the introductory 
Section [H We also introduce 

A(y) := ^T*y), yey 
A{uj) := $(T*cj), ioeX* 

which look like the definition (12.21) . Note that thanks to (12. 5p . the first equality is mean- 
ingful. Because of the previous remarks, the restriction of A to 3^ is A. 



The optimization problems. Let $* and $* be the convex conjugates of $o and $ with 
respect to the dual pairings {Uo, Co) and {U, C) : 

$:(£) := sup{(m,£)-$o(m)}, ^eCo 

ueUo 

$*(^) := sup{(M,£) -$(«)}, ieC 

and A*, A* be the convex conjugates of Aq, A with respect to the dual pairings (3^o, A'o) 
and (y, X) ■ 

A*(a;) := sup{(?/, x) - Ao(?/)}, x ^ Xo 

y&yo 

A*{x) := sup{{y,x) -A{y)}, xeX 
y&y 
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Finally, denote C = n A". 

The optimization problems to be considered are: 



minimize $*(^) 




subject to Tgi G Co, 






minimize $*(£) 




subject to Ti G C, 


ieC 




minimize A* (a;) 




subject to X E C, 


X e X 


(P^) 


maximize inf {y, x) 






yeyo 


m 


maximize inf {y, x) - 






yey 


(D) 


maximize inf (x, uj) 


-AM, 






(D) 



2.4. Statements. We are now ready to give answers to the Questions 11.11 related to (P) 
and (P>). 

Theorem 2.6 (Primal attainment and dual equality). Assume that (-ff<i>) and (Ht) hold, 
(a) For all x in Xo, we have the little dual equality 

mi{^:{iy,i e Co,T J = x} = Alix) G [0,oo]. (2.7) 

Moreover, in restriction to X, A* = A* and A* is a{X ,y) -inf- compact, 
(h) The problems (Pq) and (P) are equivalent: they have the same solutions and 
inf (Po) = inf (P) G [0,oo]. 

(c) If Co is convex and a{Xo,yo)-closed, we have the dual equality 

inf(P„) = sup(D„) G [0,oo]. 

Assume that {H<s>), (Ht) and (He) hold. 

(d) We have the dual equalities 

inf(Po) = inf(P) = sup(P>) = sup(D) = inf A*(x) = inf A*(x) G [0, oo] (2.8) 

(e) If in addition inf(Po) < oo, then (Pq) is attained in C. Moreover, any minimizing 
sequence of (Po) has a {C,U) -cluster points and every such cluster point solves 

(f) Let I E C he a solution to (P), then x := Tq^ is a solution to {P'^) and inf(P) = 

$*(£) = a: (x). 

Theorem 2.9 (Dual attainment and representation. Interior convex constraint). Assume 
that (H^), (Ht) and (He) hold. 

(1) For any I e C and uj G X* , 

(a) TieC 

\h) {to, Ti) < {iu, x) for allxeC (2.10) 

(c) i G dc^{T*iu) 

is equivalent to 

j i is a solution to (Po) and 
\ is a solution to (D) 

(2) Suppose that in addition the interior constraint qualification 

Co n icor (Todom^^) ^ (2.11) 

is satisfied. Then, the primal problem (Po) is attained in C and the dual problem (D) 
is attained in X*. 
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Note that (12.111) is equivalent to Co n icordomA* ^ 0. 

As can be seen in ^1 Remark 4.9], the Monge-Kantorovich problem provides an example 
where no constraint is interior. In order to solve it, we are going to consider the more 
general situation fll.2p where the constraint is said to be a subgradient constraint. This 
means that x belongs to 

diffdomA^ = {x e X;dx*Al{x) ^dl} where 
dx^Alix) = {ujeX*;Al{x')>Al{x) + {x'-x,uj),yx'eX}. 

Two new optimization problems to be considered are 

minimize <!>l{i) subject to Toi = x, i e Co (P^) 

maximize {x,uj) — A{uj), uj E X* [D^) 

where x G Xo- This corresponds to the simplified case where Co is reduced to the single 
point X. 

Theorem 2.12 (Dual attainment and representation. Subgradient affine constraint). Let 

us assume that (H^) and {Hx) hold. 

(1) For any i E C and uj G A"*, 

(a) Ti = X 



is equivalent to 

£ is a solution to (P^) and 
u is a solution to [D^) 
(2) Suppose that in addition the subgradient constraint qualification 

X G diffdomA*, (2.14) 

is satisfied. Then, the primal problem (P^) is attained in C, and the dual problem 
(D^) is attained in X*. 

It is well-known that the representation formula (12.101 -c) or (12.131 -b): 

eedc^{T*uo) (2.15) 

is equivalent to 

T*iu G dc*^*ii) 
and also equivalent to Young's identity 

$* {£) + ^T*u) = {u, Tl) = A* (x) + A{uj) . (2.16) 

Formula (12.151) can be made a little more precise by means of the following regularity 
result. 

Theorem 2.17. Assume that (-ff-j.), (Ht) and (He) hold. Any solution u of (D) or (D^) 
shares the following properties 

(a) u is in the a{X*, X)- closure o/domA; 

(b) T*LJ is in the a{C* , C)-closure o/T*(domA). 

If in addition the level sets of ^ are \ ■ \q,-bounded, then 

(a') oj is in y" . More precisely, it is in the a{y" , X)-closure o/domA; 

(b') T*uj is in U" . More precisely, it is in the a (U" , C) -closure o/T*(domA) 
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where y" and U" are the topological hidual spaces of y and U. This occurs if $, and 
therefore $*, is an even function. 

3. Examples 

The abstract results of Section [2] are exemplified by means of the Monge-Kantorovich 
optimal transport problem and the problem of minimizing entropy functionals on convex 
sets. 

3.1. The Monge-Kantorovich optimal transport problem. Denote P4, Pb and Pab 

the sets of all probability measures on the spaces A, B and A^B. Let c : B ^ [0, 00) 
a nonnegative (cost) function and two probability measures ^ E Pa and v G Pb on A and 
B. The Monge-Kantorovich problem is 



minimize vr G Pab / c(a, h) n[dadh) subject to n E -P(yU, z^) (MK) 

J AxB 

where z/) is the set of all tt G Pab with prescribed marginals vr^ = on A and 
7iB = on B. Any solution of (MK) is called an optimal plan. For a general account on 
this active field of research, see C. Villani's book [T3] . 

Without going into the details, let us indicate how this problem enters the present frame- 
work. Denote Ca, Cb and Cab the spaces of all continuous bounded functions on A, B 
and AxB. The function $0 is defined on the space Uo = Cab by 

$o(m) = i'{u<c}, u e Cab 
see ( 11.41) . The marginal constraint n G P{fi, v) is obtained choosing = Ca ^ Cb and 

T:U.g) = f®g. feCA,geCB 

with 

f (Bg{a,b) := f{a)+g{b), aeA,beB, 

see Section l373l below. This gives Ao{f,g) = i-{f®g<c} and the dual equality (12. 7p is the 
well-known Kantorovich dual equality 

inf < / c(a, b) Tt{dadb)] tc G -P(/i, i^) 

[.J AxB 

= sup 1^ /(a) /i(rfa) + gib) u{db); f e Ca, g e Cb : f ® g < c^ 

In [8], cost functions c which may take infinite values are considered and Theorem 12.121 
is used to characterize the optimal plans, yielding a new result on this well-known opti- 
mization problem. 

3.2. Entropy minimization. The problem is sketched in this section and studied in 
further details in [9J. 

Entropy. Let i? be a positive measure on a space Z and take a [0, oo]-valued measurable 
function 7* on 2 x M such that 7* (-2, ■) := 7* is convex and lower semicontinuous for all 
z E Z. Denote Mz the space of all signed measures Q on Z. The entropy functional to 
be considered is defined by 



HQ) 



I +00 otherwise ' 



where Q ~< R means that Q is absolutely continuous with respect to R. Assume that 
for each z there exists a unique m{z) which minimizes 7* with 7*(m(z)) = 0. Then, / is 
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[0, oo]-valued, its unique minimizer is mR and I{mR) = 0. 

As for each z, 7* is closed convex, it is the convex conjugate of some closed convex function 
72. Defining 

\{z, s) = 7(2;, s) — m(z)s, z E Z, s E M, 

one sees that for R-a.e. z, is a nonnegative convex function and it vanishes at 0. A 
favorable choice for Uo is the space of all measurable functions u on Z such that 



j \{z, au{z)) R{dz) < 00, for all a G M. (3.2) 



With 

Ao(2:, s) = max[A(2, s), X{z, —s)] G [0, 00], z E Z,s E 
(13. 2p is equivalent to u belongs to 



Wo = £\o '■= J ^oiz, au{z)) R{dz) < 00, Va > 
the "small" Orlicz space associated with the Young function Ao. Taking 

$o(m) = j K{u{z))R{dz) E [0,00], u E Sx, (3.3) 

leads to 

I{Q) = K{Q-mR), QeMz (3.4) 

This identity is a consequence of general results of Rockafellar on conjugate duality for 
integral functionals p5]. Moreover, the effective domain of I is included in the space 

:= |g G Mz] j \u\ d\Q\ < 00, G ^a.| • 

Constraint. In order to define the constraint, take Xq a vector space and a function 
9 : Z ^ Xq. One wants to give some meaning to the formal constraint 9 dQ = x with 
Q E and x E Xg. Suppose that Xq is the algebraic dual space of some vector space 
3^0 and define for all y G 3^o, 

T:y{z):={y,9{z))y^^;,^, z E Z. (3.5) 

Assuming that 

T^G^Ao, ^y^yo 

allows to define the constraint operator 

T,Q:= j 9dQ, QeM^o 

by 

(y, [ 9dQ) = [ {y,9{z))y^,;,^Qidz), ^y E y^. 

Minimization problem. The entropy minimization problem to be considered is 

minimize I{Q) subject to j 9 dQ E Co, Q E M^" 
where Co is a convex subset of Xo- 
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Results. Applying the abstract results of the present paper, in [9] are obtained the fol- 
lowing results. Let r*(a;) = supy^y^{{y,x) — J^'yz{{y,0{z))) R{dz)}, x G Xo- The dual 
equality is inf{/((5); Q G M|*, 9dQ G Co] = infc^ T* and under the assumption 

CoHicordomTV^, (3-6) 

the characterization of the minimizer Q is as follows. Defining x = J^6 dQ in the weak 

sense with respect to the duality (3^o, Xo), Q is a minimizer if and only if there exists some 
linear form y on Xo such that {y, 9{-)) is measurable, ao{y, 6{z))) R{dz) < oo for 

some > and 

{(a) X G Co n dom T* 
(6) < (y,x),Va; G Co n dom r* (3.7) 

(c) Q{dz)=i^{{y,e{z)))R{dz). 

where 7^(3) = §;l{z,s). 

Remark 3.8. A usual form of constraint qualification required for this representation is 
int Co n dom F* 7^ where int Co is the interior of Co with respect to some topology which 
is not directly connected to the "geometry" of F*. In particular, int Co must be nonempty; 
this is a considerable restriction. The constraint qualification Co fl icordom F* 7^ is much 
weaker. 

Literature about entropy minimization. Entropy minimization problems appear in many 
areas of applied mathematics and sciences. The literature about the minimization of 
entropy functionals under convex constraints is considerable: many papers are concerned 
with an engineering approach, working on the implementation of numerical procedures in 
specific situations. In fact, entropy minimization is a popular method to solve ill-posed 
inverse problems. 

Surprisingly, rigorous general results on this topic are quite recent. Let us cite, among 
others, the main contribution of Borwein and Lewis: [H [21 El IH O [6] together with the 
paper [12] by Teboulle and Vajda. In these papers, topological constraint qualifications 
are required: it is assumed that the constraints stand in some topological interior of the 
domain of /. Such restrictions are removed in [H]. 

3.3. Some examples of constraints. Let us consider the two standard constraints 
which are the moment constraints and the marginal constraints. 

Moment constraints. Let 6 = {9k)i<k<K be a measurable function from Z to = MJ^ . 
The moment constraint is defined by 

f edQ = ( [ Okdo] gr^ 

Jz \Jz J l<k<K 

for each Q G Mz which integrates all the real valued measurable functions Ok- 

Marginal constraints. Let Z = A^Bhe a. product space, Mab be the space of all hounded 
signed measures on AxB and Uab be the space of all measurable bounded functions u 
on AxB. Denote Ca = x B) and ^B = x ■) the marginal measures of £ G Mab- 
The constraint of prescribed marginal measures is specified by 

/ ed^ = {^A,^B)^MAyiMB, i^Mab 

J AxB 
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where Ma and Mb are the spaces of all bounded signed measures on A and B. The 
function 9 which gives the marginal constraint is 

e{a, h) = {Sa, Sb), ae A,b e B 

where Sa is the Dirac measure at a. Indeed, {(!-aAb) = ^AxB^^a^^bl^idadh). 
More precisely, let Ua, Ub be the spaces of measurable functions on A and B and take 
yo = Ua X Ub and Xo = Ua x Ub- Then, ^ is a measurable function from Z = AxB to 
Xo = Ua X Ub- It is easy to see that the adjoint of the marginal operator 

Toi = {iA, is) eU*AXU*B, ieCo = U*AB 

where (/, Ea) '-= (/ ® 1, {g, Eb) '-= (1 ® 9, ^) for all f E Ua and g E Ub, is given by 

T:{f,g) = f®geUAB, feUA,geUB (3.9) 

where / © g{a, b) := /(a) + g{b), a e A,b e B. 

4. Preliminary results 

In this section, one introduces notation and proves preliminary technical results for the 
proofs of the results of Section [2l 

4.1. The saddle-point method (for fixing notation). We are going to apply the 
general results of the Lagrangian approach to the minimization problem {Pq)- To quote 
easily and precisely some well-known results of convex minimization while proving our 
results, we give a short overview of the approach to convex minimization problems by 
means of conjugate duality as developed in Rockafellar's monograph [Tlj . 

Let A be a vector space and f : A oo, +oo] an extended real convex function. We 
consider the following convex minimization problem 

minimize f{a),a G A {V) 

Let Q be another vector space. The perturbation of the objective function / is a function 
F : Ax Q ^ [-oo,+oo] such that for q = e Q, F(-,0) = /(■)• The problem (V) is 
imbedded in a parametrized family of minimization problems 

minimize F{a, q),a & A (Vg) 

The value function of (Vq)q^Q is 

(p{q) ■-= inf('P„) = inf F{a, q) E [-oo, +oo], g G Q- 

a^A 

Let us assume that the perturbation is chosen such that 

F is jointly convex on A x Q. (4.1) 

Then, ('Pg)ggQ is a family of convex minimization problems and the value function ip is 
convex. 

Let i? be a vector space in dual pairing with Q. This means that B and Q are locally 
convex topological vector spaces in separating duality such that their topological dual 
spaces B' and Q' satisfy B' = Q and Q' = B up to some isomorphisms. The Lagrangian 
associated with the perturbation F and the duality {B, Q) is 

K{a, b) ■-= inf {(6, q) + F{a, g)}, aeA,beB. (4.2) 

qeQ 

Under fl4.ip . 7^ is a convex-concave function. Assuming in addition that F is chosen such 
that 

q I— >• F{a, q) is a closed convex function for any a G A, (4.3) 
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one can reverse the conjugate duality relation (14.21) to obtain 

F{a, q) = snp{K{a, b) - {b,q)},\/a e A,q e Q (4.4) 

beB 

Introducing another vector space P in separating duality with A we define the function 
G{b,p) := inf {K{a,b) - {a,p)},be B,peP. (4.5) 

This formula is analogous to (14. 4p . Going on symmetrically, one interprets G as the 
concave perturbation of the objective concave function 

gib) ■.= Gib,0),beB 

associated with the concave maximization problem 

maximize g{b),b G B (V) 

which is the dual problem of {V). It is imbedded in the family of concave maximization 
problems {T>p)p^p 

maximize G{b,p), b E B (Dp) 

whose value function is 

7(p) := sup G{b,p),p E P. 

beB 

Since G is jointly concave, 7 is also concave. We have the following diagram 

l{p) /(a) 

( p , . ) 

G{b,p) K{a,b) F{a,q) 

{ B , g ) 

The concave conjugate of the function / with respect to the dual pairing {Y, X) is 
f*{y) = mfx{{y,x) — f{x)} and its superdifferential at x is df{x) = {y E Y;f{x') < 
f{x) + {y,x' - x)}. 

Theorem 4.6. We assume that {P, A) and {B, Q) are topological dual pairings. 

(a) We have sup(T') = V9**(0). Hence, the dual equality inf(P) = sup('E') holds if and 
onlyif^{0) = ^**{0). 

(b) In particular, 

• F is jointly convex 1 

• ip is lower semicontinuous at > ^ inf(P) = sup(P) 

• sup(X') > —00 J 

(c) // the dual equality holds, then 

argmax g = —d(f{0). 
Let us assume in addition that ( [-^. j[ ) and o'^c satisfied. 

(a') We have inf('P) = 7**(0). Hence, the dual equality inf(P) = sup(P) holds if and 

on/?/ z/7(0) = 7''(0). 
(b') In particular, 

• J is upper semicontinuous at 1 . 

• rz-nN , r =^ vaiiVj = sup(P) 

• mf(P) < +00 j ^ ^ ^ 
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(c') // the dual equality holds, then 

argmin / = —97(0). 

Definition 4.7 (Saddle-point). One says that {a,b) & A x B is a saddle-point of the 

function K if 

K{a,b) < K{a,b) < K{a,b), yaeA,beB. 

Theorem 4.8 (Saddle-point theorem and KKT relations). The following statements are 
equivalent. 

(1) The point (a, b) is a saddle-point of the Lagrangian K 

(2) fia) < g{b) 

(3) The following three statements hold 

(a) we have the dual equality; sup(P) = inf(P), 
(h) a is a solution to the primal problem {V) and 
(c) b is a solution to the dual problem {V). 

In this situation, one also gets 

sup(P) = inf (P) = K{a, b) = f{a) = g{b). (4.9) 

Moreover, {a, b) is a saddle-point of K if and only if it satisfies 

daK(a,b) 3 (4.10) 
dbK(a,b) 3 (4.11) 

where the subscript a or b indicates the unfixed variable. 

4.2. Gauge functionals associated with a convex function. The following result is 
probably well-known, but since I didn't find a reference for it, I give its short proof. 

Let 9 : S ^ [0,oo] be an extended nonnegative convex function on a vector space S, 
such that ^(0) = 0. Let S* be the algebraic dual space of S and 9* the convex conjugate 
of ^ : 

9*{r) :=sup{{r,s) -9{s)}, r e S*. 
ses 

It is easy to show that 9* : S* ^ [0, oo] and ^*(0) = 0. We denote Cg := {9 < 1} and 
Cg* {9* < 1} the unit level sets of 9 and 9*. The gauge functionals to be considered 
are 

jg{s) := M{a > 0; s e aCg} = inf{a > 0; 9{s/a) < 1} G [0, oo], s e S. 
je*{r) := M{a > 0;r e aCe*} ^ mi{a > 0;9*{r/a) < 1} e [0,oo],r e S*. 

As belongs to Cg and Cg* , one easily proves that jg and jg* are positively homogeneous. 
Similarly, as Cg and Cg* are convex sets, jg and jg* are convex functions. 



^je*{r) < tcg{r) := sup (r,s) < 2jg*{r). 



Proposition 4.12. For all r e S*, we have 

1 

]e*{r) < tc^{r) : = 

seCg 
We also have 

cone dom^* = domjg* — domt^ 
where cone dom^* is the convex cone (with vertex 0) generated by dom^*. 
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Proof. • Let us first show that i*c^{r) < 2jQ*{r) for all r e S*. For all s e Cq and 
> j0*{r), (r, s) — {r/a, s)a < [9{s) + 9*{r/a)\a < (1 + 1)q;. Then, optimize both sides 
of this inequality. 

• Let us show that je*{r) < 2tQ(r). If t^Cgir) = oo, there is nothing to prove. So, let us 
suppose that ^^^(r) < oo. As e Ce, we have t.Cg{r) > 0. 

First case: t-Cei''^) > 0- all s e and e > 0, we have s/[je{s) + e] e Cq. It 
follows that {r/i*c^{r), s) = (r, s/\je{s) + e])^ < ^^(r)^ = je{s) + e. Therefore, 
{r/i^^ei^)^ s) < je{s), for all s e S. 

If s doesn't belong to Cg, then jels) < 0{s). This follows from the the assumptions on 9 : 
convex function such that ^(0) = = min6' and the positive homogeneity of jg. Otherwise, 
if s belongs to Cg, we have jg{s) < 1. Hence, {r j ic^ij-), s) < max(l, 6{s)),'is G S. On the 
other hand, there exists So e S such that 9*{r /[2i*c^{r)]) < (r/[2t^^(r)], So) - 9{so) + 1/2. 
The last two inequalities provide us with ^*(r/[2i^^(r)]) < \ max(l, 9{so)) — 9{so) + | < 1 
since 9{so) > 0. We have proved that jg*{r) < 2i^^(r). 

Second case: '•Ce(^) — 0- have (r, s) < for all s G Cg. As dom^ is a subset of 
the cone generated by Cg, we also have for all t > and s G dom6', {tr,s) < 0. Hence 
{tr, s) - 9{s) < for all s G 5 and 9*{tr) < 0, for all t>0. As9* > 0, we have 9*{tr) = 0, 
for all i > 0. It follows that jg*{r) — 0. This completes the proof of the equivalence of jg* 
and Lr' . 

• Finally, this equivalence implies that domje* = domt^ and as ^*(0) = we have 
G dom^^* which implies that cone dom^^* = dom jg*. □ 

4.3. Preliminary technical results. Recall that \u\^ = mf{a > 0;^±{u/a) < 1} with 
^±('") = max($o(^*); ^o{—u)). Its associated dual uniform norm is 

\e\i~ sup \{u,e)\, iec 

u,\u\^<l 

The topological dual space of (£, | ■ ||,) is denoted by U" : the bidual space of (pi, \ ■ |$). 
Similarly, recall that ||/|a = infjo; > 0;A±{y/a) < 1} with A±{y) — max(Ao(y), Ao(— y)). 
Its associated dual uniform norm is 

\x\l:= sup \{y,x)\, xeX 

2/:|2/|a<1 

The topological dual space of {X, \ ■ |X) is denoted by y" : the bidual space of {y, | • |a). 

Lemma 4.13. Let us assume {H<s>) and {Ht). 

(a) dom$* C jC and domA* C X 

(b) To(dom$;) C domA* and T^C C X 

(c) To is a {Co, ^o)-o'{Xo,y o)- continuous 

(d) T* : X* ^ C* is a {X* , X) -a {C* ,£.)- continuous 

(e) T : C ^ X is \ ■ ■ ^-continuous 

(f) T*y" C U" where y" andU" are the topological bidual spaces ofy andlA 

(g) T*y CU andT* -.y -^U is (T{y, X)-a{U, C)-continuous 

(h) T : C X is a {C,U) -a [X ,y)- continuous 

Proof. • Proof of (a). For all i ^ Co and a > 0, Young's inequality yields: (m, £) = 
a(JL,uloi) < [$o(m/q;) + for all u G Kg- Hence, for any a > \u\^, {u,i) < [1 + 

It follows that {u,i) < [1 + $*(£)] Considering -u instead of u, one gets 

\{u,i)\ < [l + ^:{i)]\u\^,\/ueUo,ieCo. (4.14) 

It follows that dom $* C £. One proves dom A* C A' similarly. 
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• Proof of (b). It is easy to show that KiTJ) < for all £ G £„. It follows 
immediately that T„(dom$*) C domA*. 

Let us consider | ■ and | ■ |a;^ the gauge functionals of the level sets < 1} and 
{A^ < 1}. As above, 

^l{To^)<^l{^), We Co (4.15) 
Therefore, To(dom$^) C domA^. On the other hand, by Proposition 14.121 the linear 
space spanned by dom $^ is dom | ■ and the linear space spanned by dom A^ is dom | ■ 
|a5^. But, dom | ■ = dom | ■ |J = £ and dom | ■ |a;^ = dom | ■ |^ = A" by Proposition 14.121 
again. Hence, ToC C X. 

• Proof of (c). To prove that Tq is continuous, one has to show that for any y e 3^o, 
i e Co ^ {y, Tod) G M is continuous. We get d i— > (?/, Tod) = {T*y, i) which is continuous 
since (Hti) gives T*y G Uo- 

• Proof of (d). It is a direct consequence of ToC C X. See the proof of (c). 

• Proof of (e). We know by Proposition 14.121 that | ■ 1$;^ ~ | ■ || and | ■ |a;^ ~ | ■ |a are 
equivalent norms on C and X respectively. For all £ e C, \Ti\*^ < 2\Ti\A'^ = 2inf{a > 
0;Ai(T£/a) < 1} < 2inf{a > 0;$^(£/a) < 1}. This last inequality follows from fglSD . 
Going on, we get |T£|^ < 2|£|$-<j^ < 4|£|^, which proves that T shares the desired continuity 
property with ||T|| < 4. 

• Proof of (f). Let us take u G y". For all i e C, \{T*uj, i) c*,c\ = \{^,Ti)y,^x\ < 
\\uj\\yii\TiW < \\uj\\yf'\\T\\\i\^ where ||T|| < oo, thanks to (e). Hence, T*u stands in W. 

• Proof of (g). Take y e y. Let us show that T*y is the strong limit of a sequence 
in Uo- Indeed, there exists a sequence {yn) in 3^o such that lim^^oo 2/n = 2/ in (3^, I ■ |a)- 
Hence, for all £ G C, \{T*yn - T*y,i)c*,c\ = KVn - y,Ti)y,x\ < \\T\\\yn - ylM and 
^^'Peec,\£\i<i I ~ T*y, i) \ < \\T\\ |y„ — y\A tends to as n tends to infinity, where T*yn 
belongs to Uo for all ri > 1 by (Hti)- Consequently, T*y G U. 

The continuity statement now follows from (d). 

• Proof of (h). By (b), T maps C into X and because of (g): T*y C U. Hence, for all 
y e y, i ^ {Ti,y)xy = {i,T*y)c^u is (t(£, W)-continuous. This completes the proof of 
Lemma I4.13[ □ 

Recall that $*, A* and A* are the convex conjugates of $o, Aq and A for the dual 
pairings {Uo,Co), {yo,Xo) and {y,X). 

Lemma 4.16. Under the hypotheses {H<^) and {Ht), we have 
(a) $o = $ on Uo] 
(h) Ao = A on yo] 
(c) $* = $* on C. 

Proof, (a) follows directly from Lemma 14.131 -a and the assumption that $o is closed con- 
vex, (b) follows from (a). 

Let us show (c). As Uo is a dense subspace of U, we obtain that $ is the convex a(U, C)- 
lower semicontinuous regularization of $o + where tUo is the convex indicator of Uo- 
Since the convex conjugate of a function and the convex conjugate of its convex lower 
semicontinuous regularization match, this implies that $* = $* on C. □ 

Lemma 4.17. Under the hypothesis {Hq,), 

(a) $* is a{Co,Uo)-'i'nf-compact and 

(b) <I>* is a{C,U)-inf-compact. 
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Proof. • Proof of (b). Recall that we already obtained at fH?Ti|) that \{u,i)\ < [1 + 
$*(£)] for all u E Uo and i G Co- By completion, one deduces that for all i E C and 
ueU,\{u,i)\< [1 + $*(£)] ($* = on C, Lemma SH-c.) Hence, < A implies 

that < A + 1. Therefore, the level set {$* < A} is relatively cr(£, W)-compact. 
By construction, $* is (t(£, W)-lower semicontinuous. Hence, {$* < A} is cr(£, W)-closed 
and cr(£, W)-compact. 

• Proof of (a). As $* = $* on £ (Lemma li?T6] -c). dom<l>* C C (Lemma liTTSl -a) and Uo C 
U, it follows from the ct(£, W)-inf-compactness of $* that $* is cr(£o, Wo)-inf-compact. □ 

5. Proofs of the results of Section [2] 

The results of Section [2] are a summing up of Proposition 15.21 Lemma 15.61 , Proposition 
15. 7[ Corollary 15.121 Lemma I5.13[ Proposition 15.151 Corollary I5.20[ Proposition 15.261 and 
Proposition I5.36[ 

5.1. A first dual equality. In this section we only consider the basic spaces Uo,Co,yo 
and Xo. Let us begin applying Section Wl] with {P,A) = {Uo,Co) and {B,Q) = (3^0, '^o) 
and the topologies are the weak topologies a{CoMo), cr(p(o, Co), cr{Xo, 3^o) and (t(3^o, Xo). 
The function to be minimized is /(£) = $*(£) + Lc^(Toi), i E Co- The perturbation F of 
/ is Fenchel's one: 

Fo{i, x) = <!>:{£) + icATJ + x), ieCo,xe Xo. 
We assume (Hti)'- T*yo C Uo, so that the duality diagram is 

Uo ) Co 



T* To (Diagram 0) 

yo , K 

The analogue of F for the dual problem is 
God/, u) := mi{{y, x) - {u, i) + Fo{£, x)} = inf {y, x) - ^o{T*y + u), yeyo,ueUo 

The corresponding value functions are 

= inf{$:(^);^e£o:rjGC,-x}, x ^ Xo 
7o(m) = sup{ inf -<I>o(T„*?/ + m)}, u eUo- 

The primal and dual problems are (Po) and (Do). 

Lemma 5.1. Assuming {Hq,) and (Hn), if Co is a a{Xo,yo)-dosed convex set, Fq is 
jointly closed convex on Co x Xo. 

Proof. As To is linear continuous (Lemma l4.13j -c) and Co is closed convex, {(£, x); Toi+x G 
Co} is closed convex in Co x Xo- As $* is closed convex on Co, its epigraph is closed convex 
in Co X R. It follows that epiFo = {Xo x epi$;) n [{(x,£);TJ + x e Co} x R] is closed 
convex, which implies that Fq is convex and lower semicontinuous. As it is nowhere equal 
to — oo (since inf Fq > inf $* > — oo), Fq is also a closed convex function. □ 

Therefore, assuming that Co is a a{Xo, 3^o)-closed convex set, one can apply the general 
theory of Section 14.11 since the perturbation function Fq satisfies the assumptions (14.11) 
and (gSD- 
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Proposition 5.2. Let us assume that and {Ht) hold. If Co is convex and a{Xo, 3^o)- 
closed, we have the dual equality 

mi{Po) = snp{Do) e [0, oo]. (5.3) 

In particular, for all x in Xo, we have the little dual equality 

mi{<^:{iy,i e Co,T J = x} = Alix) e [0,oo]. (5.4) 

Proof. The identity (15.41) is a special case of (15. 3p with Co = {x}. 

To prove ( 15. Sp . we consider separately the cases where inf(Po) < +oo and inf(Po) = +oo. 

Case where inf(Po) < +oc. Thanks to Theorem 14.61 -b'. it is enough to prove that 70 is 
upper semicontinuous at u = 0. We are going to prove that 70 is continuous at m = 0. 
Indeed, for all u G Uo, 

-7o(u) = inf{$,(T> + n) - inf {y, x)} < $„(«) 

y xeCo 

where the inequality is obtained taking y = 0. The norm | ■ |$ is designed so that $0 
is bounded above on a | ■ |$-neighbourhood of zero. By the previous inequality, so is 
the convex function —70. Therefore, —70 is | ■ |<i,-continuous on icordom(— 70) 3 0. As 
it is convex and C = {Uo, \ ■ I*)', it is also a (Wo, £) -lower semicontinuous and a fortiori 
a(Uo, £o)-lower semicontinuous , since C C Co- 
Case where inf(Po) = +00. Note that sup(Do) > —$0(0) = > —00, so that we can 
apply Theorem I4.6j -b. It is enough to prove that 

lsv?o(0) = +00 

in the situation where v9o(0) = inf (Po) = +00. We have ls(/?o(0) = supygjy(o) inf {$*(£); i : 
Toi G Co + V} where A/'(0) is the set of all the cr{Xo, 3^o)-open neighbourhoods of G Xq. 
It follows that for all V G A/'(0), there exists £ G Co such that Tgi E Co + V and 
$*(£) < lsv?o(0). This implies that 

To({<l>:<ls^o(O)})n(Co + l^)^0, VVGAr(O). (5.5) 

On the other hand, inf(Po) = +00 is equivalent to: To(dom$*) fl Co = 0. 

Now, we prove ad absurdum that lsv9o(0) = +00. Suppose that h(po{0) < +00. Because 

of To(dom$*) n Co = 0, we have a fortiori 

To({$:<is<^o(o)})nCo = 0. 

As $* is inf-compact (Lemma I4.17j -a) and To is continuous (Lemma 14.131 -c). To({$* < 
Is v^o(O)}) is a a{Xo, 3^o)-compact subset of Xo. Clearly, it is also convex. But Co is assumed 
to be closed and convex, so that by Hahn-Banach theorem, Co and To({<l'* < h{po{0)}) 
are strictly separated. This contradicts (15.51) . considering open neighbourhoods V of the 
origin in (15.51) which are open half-spaces. Consequently, ls9?o(0) = +00. This completes 
the proof of the proposition. □ 

5.2. Primal attainment and dual equality. We are going to consider the following 
duality diagram, see Section 12.31 

(w , C 

y , X 



T (Diagram 1) 
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Note that the inclusions TC C X and T*y C U which are stated in Lemma 14.131 are 
necessary to vahdate this diagram. 

Let and 71 be the analogues of Fq, Gq and 70. Denoting ipi the primal value 

function, we obtain 

Gi{y,u) = mUy,x) -^iT*y + u), yey,ueU 

(^i(x) = mf{<l>*{i);ieC:TieC -x}, xeX 

7i(u) = sup{ inf (y, x) — $(T*?/ + u)}, uElA 
y&y ^ec 

It appears that the primal and dual problems are (P) and {D). 

Lemma 5.6. Assuming (H^) and {Hx), the problems (Po) and (P) are equivalent: they 
have the same solutions and inf(Po) = inf(P) G [0, 00]. 

Proof. It is a direct consequence of dom $* C C, ToC C X and $* = $* on £, see Lemma 
I4.13j -a.b and Lemma [4.16l -c. □ 

Proposition 5.7 (Primal attainment and dual equahty). Assume that {H<^) and (Ht) 
hold. 

(a) For all x in X , we have the little dual equality 

inf{$:(£);£ G Co,Toi = x} = A*{x) G [0,oo]. (5.8) 

Assume that in addition (He) holds, 
(h) We have the dual equalities 

inf (Po) = sup(P>) G [0, 00] (5.9) 
inf(Po) = inf (P) = inf A*(x) G [0, 00] (5.10) 

(c) If in addition inf(Po) < 00, then (Pq) is attained in C. 

(d) Let i E C be a solution to (P), then x := Tl is a solution to (P'^) and inf(P) = 
$*(£) = A*(:r). 

Proof. • We begin with the proof of (15.91) . As inf (Po) = inf(P) by Lemma [5.61 we have 
to show that inf(P) = sup(P'). We consider separately the cases where inf(P) < +00 and 
inf(P) = +00. 

Case where inf(P) < +00. Because of [He), Pi is jointly convex and Pi(£, ■) is a{X ,y)- 
closed convex for all £ G £. As T*y C 14 (Lemma 14.131) . one can apply the approach of 
Section [4.11 to the duality Diagram 1. Therefore, by Theorem 14.61 -b'. the dual equality 
holds if 7i is a{U, £)-upper semi continuous at 0. As in the proof of Proposition 15. 2^ we 
have — 7i(n) < $(m), for all u eU. But $ is the (t{U, £)-lower semicontinuous regulariza- 
tion of $0 + on U and $0 is bounded above by 1 on the ball {u G Uo] < 1}. As 
C = (U, I ■ 1$)', $ is also the | ■ |<i,-regularization of ^o + t'Uo- Therefore, $ is bounded above 
by 1 on {m G U; < 1}, since {u G Uq] \u\<s, < 1} is | • |$-dense in {u eU; \u\<s, < 1}. As 
— 7i(< ^) is convex and bounded above on a | ■ |$-neighbourhood of 0, it is | ■ [^-continuous 
on icordom (—71) 3 0. Hence, it is a(U, £)-lower semicontinuous at 0. 

Case where inf(P) = +00. This proof is a transcription of the second part of the proof 
of Proposition 15.21 replacing To by T, Co by C, all the subscripts by 1 and using the 
preliminary results: $* is inf-compact (Lemma 14.171) and T is weakly continuous (Lemma 
I4.13j -h). This completes the proof of (15.91) . 
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• The identity flS.Sp is simply (15.91) with C = {x}. 

• Let us prove (c). By Lemma r4.13l -h. T is cr(£, W)-cr(Af, 3^)-continuous. Since C is 
cr(A', 3^)-closed, {i E C;Ti E C} is cr (£,W)-closed. As $* is (T(£,Z//)-inf-compact (Lemma 
I4.17p . it achieves its infimum on the closed set {£ E C]Ti E C} if inf(P) = inf (Po) < co- 

• Let us prove (IS.lOp . The dual equality (15.90 gives us for all Xo E C, inf(P) = 
suPyey{^T^ixGc{y,x) - A{y)} < snpy^y{{xo,y) - A{y)} = A*{xo). Therefore 

inf(P) < inf A*(x). (5.11) 

In particular, equality holds instead of inequality if inf(P) = +oo. Suppose now that 
inf(P) < oo. From statement (c), we already know that there exists i E C such that 
X := Ti E C and inf(P) = $*(£). Clearly inf(P) < inf {$*(£); T£ = x,i E C} < $*(£). 
Hence, inf(P) = inf{<l>*(£);T£ = x,i E C}. By the little dual equality ([EHD we have 
inf {$*(£); Ti = x,i E C} = A*{x). Finally, we have obtained inf (P) = A*{x) with x E C. 
Together with (15. lip , this leads us to the desired identity: inf(P) = mf^fzc A*{x). 

• Finally, (d) is a by-product of the proof of (15.100 . □ 

Corollary 5.12. We have domA* C domA*, domA* C X and in restriction to X, 
A* = A*. 

Proof. The first part is already proved at Lemma [4.13j -a. The matching A* = A* follows 
from ([53]) and dSSD- □ 

Lemma 5.13. Under the hypotheses (-f^#) and {Ht), A* is a{X ,y) -inf- compact. 

Proof By dEH]): inf{$*(£);^ G C,T£ = x} = A*{x) for a\\ x E X (note that $* = $* on 
C by Lemma [4.16l -c.) As T is continuous (Lemma I4.13j -h) and $* is inf-compact (Lemma 
I4.17p . it follows that A* is also inf-compact. □ 

5.3. Dual attainment. We now consider the following duality diagram 

C , C* 



T 



T* (Diagram 2) 

X , X* 



where the topologies are the respective weak topologies. The associated perturbation 
functions are 

P2(£,x) = $*(£) + 6c (T£ + x), tEC.xEX 
G2(C,^) = inf -$(T*cu + C), C ^ ^ X* 

As F2 = Fi, the primal problem is (P) and its value function is ipi : 

^Pi{x) = inf A*(x'), X EX (5.14) 

where we used (15. Sp . The dual problem is (D). 

Proposition 5.15 (Dual attainment). Assume that (-ff$), (Ht) and (He) hold. Suppose 
that 

C^nicordomAV 0- (5-16) 
Then the dual problem (D) is attained in X*. 
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Proof. As F2 = Fi, one can apply the approach of Section [4.11 to the duahty Diagram 
2. Let us denote ipl* the <7{X, 3^)-lower semicontinuous regularization of (pi and yjg* 
a{X, A:'*)-lower semicontinuous regularization. Since X separates y, the inclusion y C X* 
holds. It follows that ^l*{0) < yD**{0) < (/?i(0). But we have (EH) which is <^l*{0) = ^i(O). 
Therefore, one also obtains (P2*i^) = V^i(O) which is the dual equality 

inf(P) = sup(D) (5.17) 

and one can apply Theorem 14.61 -c which gives 

argmax(D) = —d(pi{0). (5.18) 

It remains to show that the value function ipi given at fl5.14p is such that 

9(^1(0)^0. (5.19) 

As the considered dual pairing is the saturated algebraic pairing, for ( 15.19^ to 

be satisfied, by the geometric version of Hahn-Banach theorem, it is enough that G 
icordom (pi. But this holds provided that the constraint qualification (15.161) is satisfied. □ 

Supposing that inf(Po) < 00 one knows by Proposition 15.71 -d that (P'^) admits at 
least a solution x = Ti where £ is a solution to (P). Let us consider the following new 
minimization problem 

minimize $*(£) subject to Ti = x, £ E C {P^) 

Of course £ is a solution to (P) if and only if it is a solution to (P^) where x = Ti. 
Since our aim is to derive a representation formula for i, it is enough to build our duality 
schema upon (P^) rather than upon (P). The associated perturbation functions are 

P|(£,x) = $*(£) + qi.}(T£ + x), ieC,xeX 

GliC,uj) = {x,u)-^T*uj + C), Ce£*,cuGA'* 
As F2 is Pi with C = {x}, the primal problem is (P^) and its value function is 

!ff{x)=A*{x-x), xeX. 

The dual problem is 

maximize {x,uj) — A{uj), uj G X* (D^) 

Corollary 5.20 (Dual attainment). Assume that (i/$) and {Ht) hold. Suppose that 
Co n domA* 7^ 0. Then, inf(Po) < 00 and we know (see Proposition IS.I^ d) that (P"^) 
admits at least a solution. If in addition, there exists a solution x to {P'^) such that 

X G diffdomA*, (5.21) 
then the dual problem (D^) is attained in X* . 

Proof. Let us specialize Proposition 15.151 to the special case where C = {x}. The dual 
equality fl5.17p becomes 

inf(P^) = sup(D*) (5.22) 

and f l5.19p becomes dipf{0) 7^ which is implied by f l5.2ip . □ 

Remark 5.23. Let us denote the extended real functions on X* 

Ai := A + Ly 
A2 := A 
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We also denote Al, their convex conjugates with respect to and Ai, A2 their 

convex cr(A'*, A')-lower semicontinuous regularizations. Clearly, 



and the dual equality f l5.22p is 
which implies the identity 



A* = A* 

A* = a; (5.24) 



Al = A2 (5.25) 

Usual results about convex conjugation tell us that A*(a;) = sup^^^* {{x,lj) — Ai(co')} = 

sup(D^) and the above supremum is attained at uj if and only if a) G dx*A.*{x). This is 
the attainment statement in Corollary 15. 20[ 

5.4. Dual representation of the minimizers. We keep the framework of Diagram 2 
and derive the KKT relations in this situation. The Lagrangian associated with F2 = Fi 
and Diagram 2 is for any i & C,uj E X* , 

K2{i,u) := inf { (x, c^) + $*(£) + 6c (T£ + a;)}, 

= <!>*{£)- {Ti,uj) + mf{x,uj). 

Proposition 5.26 (Dual representation). Assume that (-ff$), (Ht) and (He) hold. 
For any i E C and u G X*, 

(a) Tie Co 

(b) {lu, Ti) < {lu, x) for allxeC (5.27) 

(c) i G dc^{T*uj) 

is equivalent to 

i is a solution to {Po), 

u is a solution to (D) and (5.28) 
the dual equality Ii5.9\) holds. 

It is well-known that the representation formula fl5.27l -c): 

i G dc^{T*u) (5.29) 

is equivalent to 

T*oo G dc*^*{i) 
and also equivalent to Young's identity 

$*(£) + $(T*cu) = {u,Ti). (5.30) 

Proof. This proof is an application of Theorem 14.81 Under the general assumptions (H^), 
(Ht) and (He), we have seen at Proposition 15.151 that the dual equalities fl5.17p and (15.221) 
hold true. Hence, f l5.28p is equivalent to {i,uj) is a saddle-point. All we have to do now is 
to show that (15. 270 is a translation of the KKT relations f l4.10p and (14. lip . 
With K2 as above, and fICTD are deK2{i,u) 3 and d^{-K2){i,u) 3 0. Since 

— {T£, uj) is locally weakly upper bounded as a function of u around u and as a function 
of i around i, one can apply (Rockafellar, pjj. Theorem 20) to derive deK2{i,uj) = 
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d^*{i) - T*LU and dU-K2)ii,tu) = di-mi^^dx, ■)) + Ti. Therefore the KKT relations 
are 

T*io G d^*{£) (5.31) 
-Ti G d{L*_c){io) (5.32) 
where is the convex conjugate of the convex indicator of —C. 

As a convex conjugate, $* is a closed convex functions. Its convex conjugate is There- 
fore (15.311) is equivalent to the following equivalent statements 

i G d^{T*oo) 

$*(£) + $(T*cj) = {i,T*u) 

Similarly, as a convex conjugate l^q is a closed convex functions. Its convex conjugate 
is L_Q where C stands for the a{X, A'*)-closure of C. Of course, as C is a{X, 3^)-closed 
by hypothesis (He), it is a fortiori cr(A', A'*)-closed, so that C = C. Therefore (15.321) is 
equivalent to 

Lc{Ti) + 6lc(cj) = {-Ti,io). (5.33) 

It follows from (15.331) that LciTi) < oo which is equivalent to Ti G C. 

Now (I5.33P is —{Ti,Lj) = = —mfx^ci^,^) which is {Ti,uj) = mi^^ci^,^) ■ This 

completes the proof. □ 

Remark 5.34. Thanks to Proposition 15.71 -d. (I5.30p leads us to 

A*{x) +A{iu) = {x,Lo) (5.35) 

for all X G domA* and all Co G X* solution to {D^). By Young's inequality: A2(x) + 
^2(^0) > {x,uj) and the identities (I5.24p and (I5.35p . we see that A2{uj) > A(Cd). But, the 
reversed inequality always holds true. Therefore, we have A2(ci;) = A(a;). This proves that 
A = A2 on domA : A is cr{X*, A')-lower semicontinuous on its effective domain. 

Proposition 5.36. Assume that (H^), (Ht) and (He) hold. Any solution u of (D) or 
(D^) shares the following properties 

(a) uj is in the a{X*, X) -closure of domA; 

(b) T*uj is in the a{C* , C)-closures o/T*(domA) and dom<l>o. 

If in addition the level sets of ^ are \ ■ \q,-hounded, then 

(a') uj is in y" . More precisely, it is in the a {y" , X)- closure of domA; 
(b') T*LJ is in U". More precisely, it is in the a (U" , C) -closures 0/ T*(domA) and 
dom$o 

where y" and U" are the topological bidual spaces of y and lA. This occurs if $, and 
therefore $*, is an even function. 

Proof. • Proof of (a). Because of (I5.35p . we have u G domA. As A2 < A and Ai = A2 (see 
(I5.25P ). we obtain Co G dom Ai which implies that Co is in the cr{X*, A')-closure of domA. 

• Proof of (b). By Lemma [4.131 -d. T* is continuous from X* to C*. It follows from (a) 
that T*Cd is in the cr (£*,£) -closure of T*(domA). 

On the other hand, T*Cd G dom$ and $ is the a{C* , C)-c\osed convex regularization of 
$0. It follows that T*Cd is in the (t(£*, £)-closure of dom$o. 
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• Proof of (a'). Because of (a), oj is the a{X* , XyXiYait of a generalized sequence {ya} 
in domA. Our additional assumption allows us to take {Ua} in a | ■ |$-ball: it is an 
equicontinuous set. It follows with [T, Cor. of Prop. III.5] that uo is continuous on X . 

• Proof of (b'). Similar to (b)'s proof using (a') and Lemma [4. 131 - f. □ 
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